Geometry of quantum observables and thermodynamics of small systems 
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The concept of ergodicity — the convergence of the temporal averages of observables to their ensemble 
averages — is the cornerstone of thermodynamics. The transition from a predictable, integrable behavior to 
ergodicity is one of the most difficult physical phenomena to treat; the celebrated KAM theorem is the prime 
example. This Letter is founded on the observation that for many classical and quantum observables, 

the sum of the ensemble variance of the temporal average and the ensemble average of tem- 
poral variance remains approximately constant across the integrability-ergodicity transition. 

We show that this property induces a particular geometry of quantum observables — Frobenius (also known 
as Hilbert-Schmidt) one — that naturally encodes all the phenomena associated with the emergence of ergod- 
icity: the Eigenstate Thermalization effect OH!], the decrease in the inverse participation ratio |4|. and the 
disappearance of the integrals of motion. As an application, we use this geometry to solve a known problem 
of optimization of the set of conserved quantities — regardless of whether it comes from symmetries or from 
finite-size effects — to be incorporated in an extended thermodynamical theory of integrable, near-integrable, 
or mesoscopic systems Finally, we propose to use theses geometric structures to construct a "Maxwell 

demon of nonergodicity": a measurement that enables one to select useful beyond-ergodicity fluctuations of the 
tem pora l averages around the ensemble mean. We regard the cooling of nano-sized opto-mechanical devices 
fig - Ugl as the ultimate field of application for these ideas. 
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If the initial velocity vector of a billiard ball in a rectangular 
billiard with periodic boundary conditions is known, the sub- 
sequent evolution of the velocity is trivially predictable: both 
components of the velocity vector will remain equal to their 
initial values forever. However, if the only information we 
have about the initial condition is that it has been indiscrimi- 
nately drawn from a thermal distribution, we have no means 
to predict the velocity at later times; the measurement results 
will strongly fluctuate from one realization to another. 

Inserting a strong localized obstacle inside the billiard 
makes it ergodic, and the situation reverses: now, the infinite 
time averages of a given velocity component remain the same 
across the realizations (namely, equal to zero). At the same 
time, for a given realization, the temporal fluctuations of the 
component are large and unpredictable. Moreover, its shot- 
to-shot variance in the — exactly integrable — case of an empty 
billiard equals its temporal variance in the ergodic case. 

Given some imagination, one may suspect a "conservation 
law" acting across the transition from an integrable to an er- 
godic system as one increases the strength of the integrability- 
breaking perturbation. Indeed, Fig.QJ shows that in the case 
of square billiard perturbed by a soft localized potential bar- 
rier in the middle lfl7ll . the sum of the microcanonical vari- 
ance of the time average, VarMc[Mcan t [A|], and the shot- 
to-shot average of the temporal variance, MeaiiMc[Var t [A]], 
with the observable A being the difference between the hori- 
zontal and vertical kinetic energies, remains the same for the 
hights of the barrier less than or comparable to the kinetic en- 
ergy. For all points, the statistical ensembles used were micro- 
canonical ensembles with the the same phase-space volume 
(W = 1184.3) covered and with the same phase-space vol- 
ume (Wb = 7895.7) occupied by the phase-space points with 
energies below the lower-energy boundary of the microcanon- 
ical widndow. Such a set of microcanonical ensembles is the 



closest classical analogue of a quantum set that uses the same 
window of quantum state indices for all perturbation strengths 
used. 

Let us now try to translate the conjecture expressed in the 
first paragraph of this Letter to quantum language. 

Naively, one may try to replace the ensemble of classical 
initial conditions by an ensemble of random superpositions of 
the quantum eigenstates. However, consider a limiting case of 
an integrable system. There, a single given initial state will 
already cover a variety of — generally unrelated — sets of the 
integrals of motion. To the contrary, in the classical case, a 
given initial point corresponds to a single set. Accordingly, 
we suggest an ensemble of randomly chosen eigenstates of 
the Hamiltonian as the ensemble of the initial conditions. In 
particular, the ensemble variance of the temporal means will 
be translated to the quantum language as 

Var MC [Mean t [A]] ^ = Var M c[(a|i|a}] 

= (AW)- 1 £ ((a\A\a) - (A)) 2 , (1) 

qG[MC] 

where < A >= Mean MC [A] = (A^mc) -1 EcgmcH^I") 
is the ensemble mean of the observable A, E a e[MC] ■ ■ • = 
J2ae[a a l • • • is a sum over a microcanonical window 
bounded by some energies E m i n and E max , and E a is the en- 
ergy spectrum of the system. Vanishing of the fluctuations (Q]) 
in the thermodynamic limit — the so-called Eigenstate Ther- 
malization effect — is sufficient lUrS for the emergence of er- 
godicity. Our Letter, in part, aims to devise a scale for these 
fluctuations that determines if a given observable is closer, by 
behavior, to an integral of motion or to a thermalizable ob- 
servable. 

The question of a proper quantum analogue of the tempo- 
ral fluctuations is both more involved and better studied. A 



2 



complication arrises from the fact that a quantum state is al- 
tered after each measurement. However, consider the follow- 
ing procedure: for every realization of the initial state of inter- 
est, the observable is measured only once, and then the initial 
state is prepared again. For every instant of time of interest, 
the observable is measured several times, and then, another 



instant of time is addressed. It has been argued II 1811 that this 
procedure is indeed the most suitable quantum counterpart of 
the classical temporal fluctuations along a trajectory. Further- 



more, it has been suggested that in case of an ergodic motion, 
these fluctuations are nothing else but the thermal fluctuations 
in the system lll8ll . According to this scenario, the quantum 
uncertainty in the results of the measurements is the way a 
quantum system emulates the classical instability with respect 
to the initial conditions: in both cases, the outcome of a single 
measurement is irreproducible, fundamentally so in the quan- 
tum case, and operationally so in the classical one. 
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FIG. 1: Two variances. The units are such that m = L/(2n) — 1, where m is the particle mass, and L is the side of the billiard, a, 
Ensemble mean of the temporal variance vs. the ensemble variance of the temporal mean of the difference between the x— and y— kinetic 
energies for rectangular billiard with periodic boundary conditions perturbed by a soft-core barrier. At zero barrier hight, the mean energy over 
the ensemble is Eq = 33.7 . The points plotted are labeled by the ratio, V/E, of the barrier hight to the mean energy of the ensemble (that 
includes the energy of the barrier), b, Ensemble mean of the quantum variance vs. the ensemble variance of the quantum expectation values for 
three integrals of motion of a system of hard core bosons, where the integrals of motion are partially destroyed by adding a soft-core two-body 
repulsive potential. For this figure: the number of particles is TV = 4, the number of lattice sites is L = 16, and we impose open boundary 
conditions. The soft-core interaction potential has a constant hight U at distances of four sites or less, and it is zero otherwise. I4, (see Ref. 
17^1 for the exact expression) and Is are the integrals of motion related to the forth and sixth moments of the momentum distribution of the 
underlying free fermions. /random is an artificial integral of motion represented by a diagonal — in the basis of the unperturbed eigenstates — 
matrix with random entries, uniformly distributed between —1 and +1. For this observable, the square cosine of the angle between a point on 
the figure and the horizontal axis equals (up to small corrections of the order of (TVmc) 1 ) to the inverse participation ratio 77 (see Q). Observe 
also that the behavior of the two other observables is qualitatively simlar. 



Accordingly, we define the quantum analogue of the ensemble 
mean of the temporal variance as 



Mean MC [Var t [A]] 



QM 



= Mcan MC [(a|i 2 |a) - (a\A\a) 2 } 

= (N MC y 1 (a\A 2 \a) - (a\A\a) 2 . (2) 

ae[MC] 

Consider now an integrable system with hamiltonian 



perturbed by a non-integrable perturbation V. The corre- 
sponding hamiltonian reads H = Hq + gV, where the pa- 
rameter g determines the degree by which the integrability is 
broken. Let \a) be the eigenstates of latter hamiltonian. The 
conjecture in the first paragraph of the Letter then reads: 



Var M c[Mean t L4]] 



QM 



Mean M c [Var t [A] 



QM 

independent of g 



(3) 
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The data presented in Fig. [TJi tests the conjecture (01 us- 
ing an example of a one-dimensional gas of lattice hard-core 
bosons perturbed by an added two-body soft-core repulsive in- 
teraction. In one dimension, both continuous-space and lattice 
hard-core bosons are known to be integrable: in both cases, 
there is a map (Girardeau's map l20ll and the Jordan-Wigner 
transformation respectively) that connects the eigenstates of 
the system to the eigenstates of a free Fermi gas. The inte- 
grals of motion are thus represented by occupation numbers 
of the eigenstates of the one body hamiltonian for the parti- 
cles of the underlying free Fermi gas. 

We analyze the decay of the fourth and sixth integrals of 
motion [17] as we increase the strength of the non-integrable 
perturbation. One can see that while the quantum (the ana- 
logue of thermal) fluctuations gradually increase, the devia- 
tions from the ergodicity decreases. However, in accordance 
with the conjecture ([3]), the sum of the two variances remains 
approximately constant. The square of the radius of the circles 
corresponds to the ensemble variance of the observable, over a 
series of single measurements — with no subsequent quantum 
or temporal averaging — on a randomly chosen eigenstate. 

Let us now reveal the intuition behind the conjecture 
The left-hand-side of the relationship (0 can be written, by 
rearranging the terms in Eqns. Q]and[2] as an ensemble vari- 
ance of the observable A: 

Var M c fMean t \A] 1 + Mcan M c \ Var t \A] " 

QM ' QM 

= MeaiiMC [A 2 ] - Mean M c [A] 2 . (4) 

In turn, the ensemble variance in the right-hand-side of the 
above equation is a function of two ensemble means. Now 
remark that in gases, ergodicity emerges for an interaction 
strength much weaker than the one required to alter the ther- 
mal expectations of the observables. For example, even 
though the Van-der-Waals interactions between the molecules 
constituting the air do not modify the Maxwell distribution, 
the interactions are strong enough to lead to a Maxwell dis- 
tribution from any initial state. Thus, physically, one would 
expect that the right-hand-side of Eq. (|4]i remains equal to its 
value in the absence of interactions all the way into the emer- 
gence of ergodicity. And this is exactly the scale the fluctua- 
tions should be compared to in order to assess the thermaliz- 
ability of the observable. 

Observe now that in the right hand side of the relation- 
ship in Eq. (0, we find an (approximately) invariant quadratic 
polynomial build out of the matrix elements of the observ- 
able A, and what we have in the lefthand side is a sum of two 
quadratic polynomials that vary with a parameter g. This re- 
alization inspires one to seek a geometric meaning of the rela- 
tionship in Eq. (0, where the right hand side is a square norm 
of an unknown vector that is linearly related to the operator A, 
and the left hand side is a decomposition of this square norm 
over some (changing with the perturbation strength g) com- 
plementary subspaces of the linear space the vector belongs 
to. From what follows, we will see that this is almost what 
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FIG. 2: The Hilbert-Schmidt geometry and quantum 
integrability-ergodicity transition. The iV 2 -dimensional space 
of quantum operators acting in an iV-dimensional Hilbert space is 
divided onto a sum of three subspaces: a one-dimensional space 
spanned by the identity operator, an (N — 1) -dimensional space, 
C A d jj, of traceless diagonal — in the basis of the eigenstates of 
the hamiltonian in question — real matrices, and an N(N — 1)- 
dimensional space of the purely off-diagonal — in the above 
sense — Hermitian matrices, £ _ d _jj. If the coupling constant g in 
the system hamiltonian H = Hq + gV changes, the C iX d _# and 
A>-d-H undergo a rotation, while the identity axis, the projection to 
which is proportional to the microcanonical average, remains the 
same. However, the Hilbert-Schmidt vector corresponding to a given 
observable of interest remains fixed along with the identity axis 
(and thus also along with the microcanonical average). Observables 
with a large projection onto C n d _fj correspond to quasi-conserved, 
non-ergodic quantities. In the opposite case, a large projection 
onto the C o i ^ space signifies a thermalizable observable, whose 
infinite time average coincides with its thermal expectation value. 
Ergodicity is reached when £ _ d _j} aligns with the traceless versions 
of all empirically relevant observables — e. g. with all one-, two-, and 
three-body obseravbles in a many-body system. 



happens, with the exception of the McanMc[^4] 2 term that be- 
longs rather to the left-hand side. The inner product that gen- 
erates the anticipated geometric structure is the Frobenius or 
Hilbert-Schmidt inner product. 

The Frobenius or Hilbert-Schmidt (HS) inner product be- 
tween two matrices reads: 



(A\B) = Tr[A^B] 



(5) 



Quantum observables, represented by Hermitian matrices, 
form a linear space over the field of real numbers; the product 
in Eq. (0 induces a real-valued inner product on this space. 
Observe also that this product is invariant under unitary trans- 
formations A i ^ t/AU^ 1 , where U is a unitary matrix. Thus 
the unitary transformations form a subgroup of all possible 
linear transformations that preserve the product. 
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The Hilbert space where we are going to deploy the HS 
structure is a microcanonical window of eigenstates, of size 
N M q- Let us introduce an A^ c -dimensional linear space, 
over the field of real numbers, of all Hermitian operators 
(generally represented by complex matrices) acting within 
an TVMc-dimensional microcanonical window. The HS prod- 
uct in Eq. © constitutes an inner product on this space. 
This space can be conveniently divided onto a direct sum of 
three pair-wise orthogonal subspaces. The first one is a one- 
dimensional space, Cjj, spanned by the identity operator. The 
second, C tl d H , is the space of all traceless integrals of mo- 
tion; i.e. the space of traceless operators that are purely di- 
agonal in the basis of the eigenstates \a). Its dimension is 
Nmc — 1- The third one, C od ^, of dimension -/Vmc(^Vmc — 1), 
is the space of all purely off-diagonal operators in the same 
basis. Now, Eq. can be rewritten as MeanMc[^4 2 ] = 

MeariMC [A] 2 + Var M c [Mean t [A]] +Mean M c [Var* [A] 

QM 

and interpreted as a relationship between the norm of the op 
erator A and its projections to the members of a complete set 
of orthogonal subspaces. 

The HS angle between a traceless version of a given ob- 
servable, A t \ = A — Tr^/A^c, and the space of the trace- 
less integrals of motion constitutes a useful measure that de- 
fines where the observable lies on the "integral of motion" vs. 
"thermalizable observable" scale. Indeed, the tangent square 
of this angle is just the ratio between (the quantum analogues 
of) the temporal fluctuations and the time-average vs. ensem- 
ble average discrepancy: 



where C 



d-H 



-tl, d-H 



Cjj is the space of all diagonal oper- 



QM 



MeariMC [Var t [A] 



tan 



QM 



Var M c[Mean t [A]; 



(6) 



QM 



(see Fig. |2]for an illustration). Here and below, the angle be- 
tween an HS vector B and an HS hyperplane C is defined 
through cos 2 {8 6>c ) = EiCos 2 (^ ..); < d § c < tt/2, 
where {e^} is any orthonormalized basis set in C. If Eigen- 
state Themalization UHl] holds, the angle © approaches 90°. 

The inverse participation ratio, rj, a measure closely related 
to the transition to thermal behavior I4l l2lll22ll . also acquires a 
clear geometric meaning. It defines the average angle between 
a projector to an eigenstate of the integrable system Hq and 
the space of the integrals of motion of the new system H: 



V 



N. 



MC X! 

a, q G[MC] 



cos2 [^,(K>(ao|)] 



(7) 



ators, including the identity. 

Let is now turn to a particular application of our theory: 
namely, to the problem of optimization of the set of conserved 
quantities to be used to enhance the predictive power of ther- 
modynamics, extended to include additional conserved quan- 
tities; both integrable systems and the systems in between 
integrable and completely thermalizable will be considered. 
Since the first demonstration of such enhancement, on the 
example of one-dimensional hard-core bosons @], the ques- 
tion of which set of conserved quantities should be used in a 
general case has remained largely open. In the hard-core bo- 
son case and in subsequent realizations |23|. there existed a 
straightforward map between the integrable system of interest 
and a hidden underlying system of free particles. Convention- 
ally, the occupation numbers of the one-body eigenstates of 
the latter were assumed to constrain the relaxation dynamics 
the most. These were subsequently included in the Gibbs ex- 
ponent producing the so-called Generalized Gibbs Ensemble 
(GGE)Jl. 

The above choice of the conserved quantities is indeed the 
most natural one. However, there exist several strong in- 
centives to formalize the choice of the conserved quantities 
for GGE: (a) there are numerical indications that in case of 
a disorder-induced localization, the one-body free-fermionic 
occupations do not improve the predictive power of thermo- 
dynamics at all Jit]; (b) not every integrable system can be 
mapped to free particles; and (c) in the intermediate systems, 
between integrable and ergodic, the variations of the expecta- 
tion values of observables from one eigenstate to another are, 
for all practical purposes, indistinct for the ones generated by 
well defined integrals of motion. It is therefore desirable to 
devise a thermodynamical recipe that does not rely on a priori 
chosen constants of motion. Ideally, one should not even as- 
sume that constants of motion exist. The recipe we suggest is 
presented below. 

To begin, one identifies a linear subspace of observables 
whose relaxation the generalized ensemble is aimed to de- 
scribe. Next, one choses a diagonal traceless observable that 
minimizes the Hilbert-Schmidt angle between the space of ob- 
servables of interest and itself. Next, one repeats the proce- 
dure in the space of diagonal traceless observables orthogonal 
to the first chosen. The procedure is repeated recursively (ev- 
ery time in a space orthogonal to all the integrals of motion 
previously chosen) till the desired predictive power is reached. 
This procedure is based on the following exact result and its 
corollaries, where the HS structure naturally emerges: 
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Var GG E[(a|i|a)] < 



Var M c[(a|i|a)] 



AI 



\ 



Vai'Mc[(a|/|a)]_ 



, (8) 



where Pjj is a "super-operator" that removes the off-diagonal 
(with respect to the basis of the eigenstates of H) matrix el- 
ements, AI = maxj(/j+i — Ij) is the maximal width of a 
microcanonical window for the additional integral of motion, 
and {[Ij+i — Ij]} is a set of intervals tiling the axis of the 
integral of motion I. (See the extensive discussion in Sup- 
plementary Material 111711 .) Here and below, VarGGE[(a|^4|a}] 



and VarMc[(a|^4|a)] define the mean square error of the (mi- 
crocanonical version of) GGE and of the microcanonical en- 
semble proper. 

Fig.[3]shows the result of an application of this procedure to 
another system of one-dimensional hard-core bosons, smaller 
than before so that finite-size effects are enhanced. The space 
of observables of interest was formed by all distinct matrix 
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FIG. 3: Predictive power of two extensions of the microcanonical ensemble. We use the example of a system of one-dimensional hard-core 
bosons. For this figure: the number of particles is N = 3, we use periodic boundary conditions, and the rest of the parameters is the same as 
for Fig. [TJj. a, An upper bound lfl7h on the mean-square error of the predictions of the Generalized Gibbs Ensemble, optimal with respect to 
all one-body observables (the optimal GGE), as a function of the allowed number of the additional integrals of motion involved. The error of 
the standard microcanonical (MC) ensemble is used as a reference. We consider the integrable case, U — 0. The result is averaged over all 
one-body observables. b, The same as for a, but away from integrability, with U = .1. c, An upper bound on the mean-square error of the 
predictions of the optimal GGE, for the momentum distribution, in the integrable case (U = 0). The number of the integrals of motion is fixed 
to the number of the lattice sites, L = 16. The results for the microcanonical ensemble, and for the conventional free-fermionic Generalized 
Gibbs Ensemble (GGE)[5] are shown for comparison. The ensemble variance of the observables is used as a reference, d, The same as for c, 
but with U — .1 . Note that in the nonintegrable case, no free theory is available for comparison. 
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FIG. 4: Momentum distribution after a quench from the ground 
state of another hamiltonian. The initial state is the ground state of 
a hard-core boson hamiltonian for N — 4 atoms on L = 16 sites, 
with periodic boundary conditions. At t — 0+, a soft-core repul- 
sion of strength U = 3 is turned on. The microcanonical ensemble 
is represented by Amc = 300 lowest eigenstates. The GGE ensem- 
ble incorporates the values of 8 most optimal integrals of motion. 
Each integral of motion (except the first, which was strongly corre- 
lated with the energy) was fixed to a window around its initial state 
value. The half-width of each window was 10% of the corresponding 
microcanonical standard deviation. 



elements of the one-body density matrix. The momentum dis- 
tribution is analyzed. We consider both the integrable case 
(Figs. |3^,c) and the case where the integrability is broken by 
a soft-core finite-range repulsive potential (Figs. |3p,d). We 
compare three thermodynamical ensembles. The first one is 
the traditional microcanonical ensemble. The second is a gen- 
eralized microcanonical ensemble that fixes not only the value 
of energy but generally all one-body occupation numbers of 
the underlying free-fermionic system (or, in the nonintegrable 
case, their time averaged values). The third is an ensemble 
based on the few first most relevant integrals of motion cho- 
sen using the Hilbert-Schmidt optimization procedure. Fig. 
[3J: demonstrates that in the integrable case, the accuracy of 
the second and the third ensembles are comparable while both 
greatly exceed the one of for the conventional thermal ensem- 
ble. This indicates that the free-fermionic integrals of motion 
are indeed the optimal predictors of the after-relaxation state 
of the system in this case. However, the free-fermionic one- 
body occupations are not available at all in the perturbed case 
(see Fig.[3jl). Nevertheless, the optimized generalized micro- 
canonical ensemble remains well defined, and it fully retains 
its predictive power. Remark that for the strength of perturba- 
tion chosen, the system remains relatively close to integrable, 
showing a high inverse participation ratio of r\ = .29. 

Finally, in Fig. [4] we consider a quench from the ground 
state in the integrable regime to a strongly perturbed regime 
(jj = .023). Here we directly compare the infinite time av- 
erage with the predictions of both the microcanonical and the 
optimal GGE ensembles. The predictive power of the latter is 
indeed higher than of the former. 

In this Letter, we suggested a simple law that governs the 
transition from an integrable to ergodic behavior. This law 



induces a particular metric in the space of quantum observ- 
ables that allows for a simple geometric interpretation of all 
the constituents of the transition. Furthermore, this metric can 
be used to formulate an unambiguous general procedure for 
identifying the integrals of motion that affect the system's re- 
laxation dynamics the most; consequently, the metric can be 
used to improve the predictive power of thermodynamic en- 
sembles, extended to include additional conserved quantities. 

Two distinct sources of deviation from the thermal behav- 
ior are traditionally identified. The first, the mathematically 
elegant one, is associated with either nontrivial symmetries or 
with the Bethe Ansatz J24, 25]. The second source, the em- 
pirically important, stems from the deviations from the Eigen- 
state Thermalization in finite systems. In small systems, — 
such as the nano-opto-mechanical resonators llOHlfJ] — the 
two become practically indistinct, and no obvious candidates 
for the relevant conserved quantities are any longer visible: 
here, our theory offers a unified approach, based on a "blind" 
optimisation of the predictive power of thermodynamics. 

Using our theory, one may foresee a possible cooling 
scheme for nanoresonators, as follows. Imagine our goal is to 
cool down the mechanical part via a (presumably nonlinear) 
contact with a colder optical cavity; imagine further that we 
have a set of cavity observables, distinct from its energy, that 
we can measure prior to the relaxation process. To reach the 
lowest possible mechanical temperature after the relaxation, 
an experimenter may choose to play the role of a "Maxwell 
demon of nonergodicity", i.e. to select only the initial states 
for which the outcome of the optical measurement indicates a 
low final mechanical energy and discard other initial states. 

Naively, for the cooling of the mechanical resonator, one 
would select the initial states with the lowest accessible en- 
ergy of the cavity. However, due to the finite size effects, (a) 
this state does not necessarily lead to the coldest state of the 
mechanical subsystem, and (b) the outcome may not be repro- 
ducible due to the finite microcanonical ensemble variance, 



VarMC [Mean f [H 



mechan.l 



QM 



of the mechanical energy. In 



the Supplementary Material 11711 . the reasoning used in Sec. 
2 is extended, in Sec. 9, to the case of "predictor" observ- 
ables that do not necessarily commute with the hamiltonian. 
It turns out that in order to make the mechanical energy more 
controllable, i.e. to make it a smoother function of the re- 
sults of the initial state measurements of accessible optical 
observables, one should choose the one, (S optlc ), that guar- 
antees the largest possible Frobenius-Hilbert-Schmidt angle 
between the traceless diagonal component of the mechanical 

observable of interest, Ph (H mecban ')a, and the linear space 

At opuc. / (S optlc )ti, where Pjj is the projector to the space of 
observables that are diagonal in the basis of the eigenstates the 
full hamiltonian H, and C A . ~ 0? ^J (S optlc ) t i is the orthogonal 

complement of the one-dimensional subspace Span[(S optlc ) t i] 
of the vector space £ (1 , i optic ., with respect to the Frobenius- 
Hilbert-Schmidt product (A\B). The latter represents the 
space of all traceless observables that (a) commute with the 
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"predictor" observable (S optlc ), and (b) are orthogonal to it in 
the HS sense. Now, the mechanical energy will be expected to 
become smoother function of the total energy and S optlc - : the 
point of the minimal mechanical energy will correspond to the 
initial conditions leading to the coldest mechanical state, in a 
controllable fashion. Since only a few mechanical modes and 
a few tens of the optical modes will be involved, finding the 
optimal practical "predictor" observable may take as little as 
an hour on a moderate laptop. 

We regard the cooling of nano-devices as the most immedi- 
ate field where our theory can be put to use. 



Here, CSI stands for the Cauchy-Schwarz inequality, | (v\ ■ 
^2)| < I l^i || 11^2 1|, and RTI denotes the reverse triangle in- 
equality, \x — y\ < \\x\ — \y\\, x and y being real numbers. 

Lemma 2. For any two real numbers a and a, 

||a_L + au\\ 2 sm 2 [6 r±+aatS±+aS ] > 

j|5J| 2 sin 2 [^, s J , (10) 

where a±, i± are real n-dimensional vectors, u is a real unit 
n- dimensional vector, \\u\\ = 1, and (a± ■ u) = (T± ■ u) = 0. 



SUPPLEMENTARY DISCUSSION 

1. Two lemmas used to establish the upper bounds on the 
accuracy of the Generalized Gibbs Ensembles. 



Lemma 1. Let q be a real n x n matrix of orthogonal pro- 
jection (i.e. let q be idempotent and symmetric: qq = q and 

qq T = 1, where T denotes transposition). Then for any two ||a±+cra|| sin [0ta ± +au] 
n-dimensional real vectors a and 1, 



Proof. Since neither the left- nor the right-hand-side of the 
inequality ( fTUb depends on the norm of 1, we may assume, 
without loss of generality, that Tis a unit norm vector: 1 = 
eV, where ||e?|| = 1. It can be further decomposed as eV = 

cos(ry)(eV)± + sm(rj)u, where (er)± = &r — (u ■ ej)u. The 
proof is as follows: 



^ 115, 



\qa\\ 2 < \\a\\ 2 { sm 2 [8t S ] + 2\cos[0 r ,s 



_1|J!M\ 



(9) 



11*11 J ' 

where ^ is the angle between two vectors v\ and V2, i.e. 
6z u z 2 = arc cos[(^i • v 2 )/(\\vi \\ \\v 2 \\)] andO < 6a u # 2 < n, 
and \\v\\ = y/ (v ■ v) is the norm of a vector v. 

Proof. Let p = 1 — q be the orthogonal projection comple- 
mentary to q. Similarly to q, it is idempotent and symmetric. 
Any vector v can be decomposed onto the sum v = pv + qv, 
with (pv ■ qv) = 0. As a consequence, ||?7|| 2 = ||pi7|| 2 + ||gi7|| 2 . 
The proof goes as follows: 



m\\ 



CSI 

< 



RTI 

< 



< 



CSI 

< 



pa\\ (using ||a|| 
i- pa) 2 



I 2 + I|g5|| 2 ) 



pi ■ a) 



(using that p is symmetric) 



(»• a) - (qt- a)Y 



M\ 2 

\(T-a)\ - \(qi-a)\) 



(using p = 1 - q) 

2 



i- a) 2 - 2|(?- a)\\(qi- a)| + (qi- af 



w 

) 2 -2\(i.a)\\(qT-Z)\ 



i- a) 2 -21(^5)111^1111511 



M\ 2 

sin 2 [% s ]+2|cos[^ a ]| 



\m 

M\ 



□ 



au\\ 2 Sm 2 [9g^ a ± +au] 



= \\a± + au\\ 2 — (<=V • (a± + auj) 

= ||5 ± || 2 -(5 r -5 ± ) 2 + (l-(e r - ? T) 2 )a 2 

- 2(eV- 5j_)(e r - u)a 

> I|5_l|| 2 - (eV- 5j_) 2 

+ min[(l — (eV - u) 2 ) a 2 - 2(eV- 5j_)(e?' u)a] 



>0 



2 (er- a±) 2 (e T - u) 2 



||5j_|| 2 - (eV • 5jJ 



l-(er-5) 2 



(er- aj_) s 



l-(e T -u) 2 
2 cos 2 [r]]((er)± ■ a±) 2 



1 — sin 2 [77] 
(using e? = cos(?7)(&r)_L + sm(n)u) 
= ||a x || 2 -((erWx) 2 
= \\a±\\ 2 sm 2 [9? ±t 5, ± } ■ (using (er)_L = u) 



□ 



2. Accuracy of a Generalized Gibbs Ensemble. A single 
additional integral of motion and a single observable of interest. 



Imagine that we are interested in predicting the infinite time 
average of the quantum-mechanical mean of an observable A, 
given the initial state. According to the standard microcanoni- 
cal scenario, the energy scale is divided onto narrow intervals, 
[E{ , Ei+i] . The only information about the initial state we are 
given is which energy interval, i*, the quantum expectation 
value of the energy belongs to. The microanonical prediction 
for the time average of the observable in the subsequent evo- 
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lution is 



Prediction [Meant [A]} 



Mean M c[A] 



i\A\a) 



y 



ED0 



1 



where Di is the interval of the eigenstate indices a popu- 
lated by the eigenstates whose energy belongs to the interval 

[Ei, E i+ i\. 



aeD l ^E a G [Ei, E. 



i+lj 



(ID 



Now, assume that in the initial state, the system's energy is 
measured exactly, yielding a value E a * , but the only infor- 
mation we get is, again, the interval Di* this energy belongs 
to. Assuming that within the interval Di* each eigenstate can 
appear with equal probability, the mean square error of the 
microcanonical prediction for the quantum-mechanical mean 
of lis 



Var M c[(a|i|a)] 



E« e zUHi|«}-MeanMc[A]) 5 



E 



aED, 



The vanishing of this variance in the thermodynamic limit is 
the essence of the Eigenstate Thermalization Hypothesis 0}- 

a. 

Imagine now that we are given an extra piece of informa- 
tion: via a second measurement in the initial state, we are 
allowed to place another integral of motion I — an observable 
with all off-diagonal matrix elements equal to zero — to an in- 
terval j*, one of a set of intervals [Ij, Ij+i]. An ensemble 

I 



of states with E a <E [Ei* , and I a 6 [Ij* , Ij*+i], dis- 

tributed with equal probability, forms a minimal version of the 
Generalized Gibbs Ensemble jj§|. Its prediction for the quan- 
tum mean of the observable A reads: 



Prediction [Mean t [A]] = Mean GGE | } * [A] 

E a e.D 4 * nS** 



t\A\a) 



EDi*nSi* 



where 



a e Sj ■ <^ l a e [Ij, Ij+i] 



Here and below, = (a|/|a). 

The predictions of the new ensemble are, by construction, 
always more accurate than the microcanonical ones. Using 
Lemma[T]from Sec. 1, one can prove the following 

Theorem. In predicting the infinite time average of an ob- 
servable A, the mean square error (MSE) of the prediction of 
Generalized Gibbs Ensemble based on an integral of motion 
I, 

MSE[Prediction[Mean t [A]]] = Var GGE [{a|i|a)] 

Ej Ea 6JV ns,««l4«> - Mcan GGE | j[yl]) 2 



y 



EDi* 



( where it is assumed that the initial states are still uniformly 
distributed inside [Ei* , Ei* + i\) is bounded from above as 



MSE[Prediction[Mean t [A]]] = Var GGE [(a|i|a}] < 



/ 



Var MC [(a|i|a}] 



V 



AI 



Var M c[(a|/|a)] 



, (12) 



where 6g ^ is the Hilbert-Schmidt angle between the ob- 
servables B\ and Bi, a traceless version of a given observ- 
able, B, is defined as B,i = B — Tr[_B]/A^M& Ph is a 
"super-operator" that removes the off-diagonal (with respect 
to the basis of the eigenstates of H) matrix elements, and 
AI = maxj (Ij+i — Ij) is the maximal width of a micro- 
canonical window for the additional integral of motion. 

The estimate in Eq. ( fT2l ) shows that the biggest increase 
in the predictive power of the Generalized Gibbs Ensemble is 
delivered by the integrals of motion at a small Hilbert-Schmidt 



angle to the observable of interest. To the dominant order in 
the size of the microcanonical boxes for the integral of motion 
AI, the bound does not depend on the details of the partition 
of the axis of the integral of motion /. 

Remark that if the bound dT2l > is used to assess the accuracy 
in a quench from a linear superposition of the eigenstates, the 
variance of the integral of motion in the initial state must be 
smaller than AI. 

The dictionary used to relate Lemma[T]to the bound (TT2b is 
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as follows: 



a | a G A*} 

1 {(a|I|a) |a G A*} 

{(a|A|a) - Mean GGE | i(Q )[A] | a G A*} 
-> {(a|l|a) - Mean GGE | i(a ) [J] | a G A*} 

2 -> Var MC [Hi|a)] +Mean MC L4] 2 



|a| 

\\4 2 -> Var MC [(a|/|a)] +Mean M c[/] 2 



|9«H 2 



1^1 



Var GGE [(a|A|o;)] 
Var GGE [(a|J|a}] . 



Lemma [2] shows that the first term of the bound in Eq. (O 
(which is the dominant term, in our context) can be further 
improved by removing a component along a particular unit 
vector u. In our case, the role of the vector u will be played 
by a Hilbert-Schmidt-normalized identity operator. The fol- 
lowing dictionary completes the proof of the theorem H21 : 



d± - 


■> {(a\A tl \a) | a G A* } 


U - 


+ {(a|4|a) | a G A*} 


u - 


+ {l/V^Mc|aG A*} 


\\s±\\ 2 - 


■> Var M c[(a|i|a)] 


Hull 2 - 


■> Var M c[(a|/|a)] 


qS±\\ 2 - 


■> Var GGE [(a|i|a}] 


|9?x|| 2 - 


■> Var GGE [(a|i : |Q;)] . 



3. Several additional integrals of motion and a single observable 
of interest. 



One can further introduce another integral of motion, A 
orthogonal to the first one: ((-^Xil-fti) = 0. Introduc- 
ing a fictitious observable with matrix elements (q;|A|q!} — 
Mcan GGE 1 j/ a -\ [A], the bound dT2b can be generalized to 

MSE[Prcdiction[Mcan t [A]]] = Var GGE [(a|i|a)] < 
Var M c[(a|i|a}] x 

1 -cos 2 f(9- s - 1 -cos 2 W - s - 

L / a ,PjiV L (/ 2 ), l ,P/fA u 

Furthermore, by induction, one can extend this bound to any 
number of (mutually orthogonal) integrals of motion N]: 

MSE[Prediction[Mean t [A]]] = Var GGE [(a|i|a}] < 
Var M c[(«|i|a)] 1 - ^ cos 2 [9 



771 — 1 



(I m )a,P H A a > 



For future applications, we will quote two other expressions 
for this bound: 

MSE[Prcdiction[Mean t [^]]] = Var GGE [(a|i|a)] < (13) 
Var M c[(a|i|a)] - Var M c[^] ^^(Z™),., aJ ' 

m— 1 



where Var M c[-4] = Mean M c[^ 2 ] - Mean M c [-4] 2 ; 

MSE[Prediction[Mean t [A]]] = Var GGE [(a|i|a}] < (14) 
VarMc[A]cos 2 [0 A|d ji/Span[{(fm)i| m=1 , 

where £/£ su \, is the orthogonal complement of a subspace 
£ su b of a vector space C with respect to an inner product 
{A\B) (the Frobenius or Hilbert-Schmidt product (A\B) in 
our case). 



4. Several additional integrals of motion and several observables 
of interest. 



Now, assume that we have several observables of interest 
(spanning a linear space £ .i.) whose long-term behavior we 
want to be able to predict. Assume further that we are given 
several integrals of motion (spanning a space £7^1) we are al- 
lowed to use as thermodynamical predictors. Next, we are 
going to form linear spaces £ .j. jt i and £/ ;t i spanned by the 
traceless versions of the same observables. Now, let us intro- 
duce orthonormal bases for both spaces: 

withg= 1, 2, . .., N oA 

((i 9 )fl|(iq0u) =<W 

(I m )ti with?n = 1, 2, . . . , Nj 

((A)tl|(A')tl) = &m,m' ■ 

In particular, this implies that VarMC [^4?] = VarMc[A] = 1 
for all q and m. Let us now form the following matrix: 

iVo.i 

R m ,m> = £ C0S ^(/ m ) tt , (A q )J C0 #(A 9 )„, (f m ,)J 
9=1 

m, m = 1, 2, . . . , Nj , 
cf. Eqn.Qj] 

It can be shown that the eigenvectors of R m ^ m i, A, when 
ordered in the descending order of their eigenvalues r„ form 
a sequence such that the first N opt . members constitute the 
most optimal Generalized Gibbs Ensemble involving N opt . 
integrals, in the sense that it minimizes, on average, the er- 
ror in the prediction of the ensemble. The requests for linear 
combinations of the observables of interest are supposed to be 
distributed according to a spherically symmetric probability 
distribution, with respect to the Hilbert-Schmidt measure. 

We show examples of a relevance sequence in Figs. 3a and 
b. In the examples considered in Fig. 3, the space Ci$ was 
represented by the whole space of traceless integrals of motion 



Ai d-H ■ T ne num ber of the most optimal (relevant) integrals 
of motion was 16 for both Fig. 3c and Fig. 3d respectively. 

5. The classical billiard with a soft-core scatterer. 

The classical mechanics example considered in the letter 
consists of a two-dimensional particle of mass m, moving 
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Sinai billiard | a=50. | E=34.2599 | M=3 



U(0,,0 r ) 




FIG. 5: The integrability-breaking barrier for the classical sys- 
tem considered:. The plot shows the "truncated" 5-function poten- 
tial used an integrability-breaking perturbation acting on a particle in 
a two-dimensional square billiard. 



in a rectangular billiard with periodic boundary conditions 
(thus topologically equivalent to a torus). As an integrability- 
breaking perturbation, we use a "truncated" <5-function: a po- 
tential that consists of the first M (including the zeroth one) 
spatial harmonics of a <5-function (see Fig. The resulting 
hamiltonian is 



H(x, y, p x , p y ) = 
sin[27r(M 



2m 2m 



V ■ 



l/2)x/L] sin[27r(M + l/2)y/L] 



(2M + 1) sm[Kx/L] (2M + 1) sm[ny/L] 



where 

0<x<L; (x = L) = (x = 0) 
< y < L ; {y = L) = (y = 0) . 

In what follows, we will be using a system of units where 



m 



1. The hamiltonian then becomes 



H(8 X , 



9 11) 

'yi J-yJ 

+ V 



I 2 

i = — 

y) 2 

sinp/ + 



I 2 

+ i 

l/2)9 x 



sin[(Af +l/2)0„ 



(2M + 1) sin^/2] (2M + 1) sin^/2] ' 

where, in this system of units, we have I a = p a and 9 a = r a 
(a = x, y)\ also, r x = x; r y = y. We used M = 3 for all 
data points. 

For any strength of the perturbation V, the initial condi- 
tions were drawn from a microcanonical ensemble bounded 
by the equi-energy surfaces (specific for a given V) in such 
a way that the phase-space volume below the lower surface 
was Wb = 7895.7, and in between the lower and the up- 
per was W = 1184.3, regardless of the perturbation strength. 
A quantum-mechanical analogue of such an ensemble would 
have the same lower and upper quantum indices of the micro- 
canonical window for all realizations. To give the reader an 
idea of the energy scale involved, we will note that for a zero 
barrier height, the mean energy in the ensemble is Eq = 33.7. 

For the test observable A, we used the difference between 
the kinetic energies in the x- and y-directions: A = AE\^ n = 

v 2 P 2 I 2 I 2 

%m ~ 2m ( wn i cn i s ~» — <t m our system of units). We studied 
both the ensemble variance of the temporal mean, 



Var MC [Mean t [A]] 



J MC d9 x =° d9 y -° dl x =° dI y -° {(lim nr ^ j^tf™ dtA{t)) -MeariMcIA]}' 

Jmc d9 x d9 y dl x dly 1 



and the ensemble mean of the temporal variance, 



(15) 



Mean MC [Var t [A]] 



J MC d9 x = d9l= dI x = dll-°lim tm ^ j^j;- dt {A(t) 



lim t „ 



1 rtimix- 
■ max <ft'—0 



J Mr ,d9 x d9„dI x dI„ 1 

r 



dt 



'Ait'))}' 



where the ensemble average is 



Mean M c [A] 



J MC d9 x d9 y dl x dl y A 
J MC d9 x d9 y dl x dl y 1 



J MC d9 x d9ydl x dl y ... is an integral over the microcanon- 
ical volume describe above, and A(t) the time depen- 
dence for the observable A along a trajectory that starts at 

(nt=0 nt=0 Tt=0 Tt=0\ 
\ u x ' y > x ' y )• 
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1 6 sites 

FIG. 6: The lattice configuration for the quantum system consid- 
ered. One-dimensional hard-core bosons on a lattice with L — 16 
sites. The number of atoms equals 4 and 3 for the Fig. lb and 3 re- 
spectively. Open boundary conditions were used for the Fig. lb; peri- 
odic boundary conditions were used for the Fig. 3. The integrability- 
breaking perturbation was represented by an added two-body inter- 
action: a constant potential energy U for any two atoms separated by 
four sites or less. 



6. The hamilitonian for one-dimensional hard-core bosons 
perturbed by soft-core interactions. 

The quantum hamiltonian used in this Letter reads 
F=-J^(StS J+1 +hx.) 

3 

+lT,J2nh,h)bibikb 2 , (i6) 

31 32 

where the commutation relations for the hard-core boson cre- 
ation and annihilation operators obey 

[b j ,b),] = [b j ,b j ,] = [b],b],]=Q, for j'Vj 

^,6t] = l, (^) 2 = (&}) 2 =0. 

The soft-core interaction potential we used was a rectangular 
potential of a four-site range: 



V(h, j 2 ) = U 



1 for |j2-ji| < Aj ri 







otherwise 



with Aj range = 4 (see Fig.©. 

For the calculations resulting in Fig. lb, the open boundary 
conditions were used: the first sum in Eq. ( fToT ) was extended 
to a range between j = 1 and j = L — 1, where L = 16 was 
the length of the lattice. Both sums in the second double sum 
were fixed between j\ >2 = 1 and ji >2 = L. 

The calculations that led to Fig. 3 were performed using 
periodic boundary conditions. There, the first sum involved 
in Eq. (IT&b covers all sites, from j = 1 to j = L. In the 
second sum, the index j% covers the same range, from j\ = 1 
to ji = L; the second index, j 2 , ranges from j 2 = 1 — Aj range 
to j 2 = L + Ajrange, so that the soft-core potential respects the 
periodic boundary conditions. 

Also, in both cases, a weak random on-site perturbation was 
used, 



where {£j } is a set of independent random variables uniformly 
distributed between —1 and +1, and the strength of the po- 
tential was fixed to W — 10~ 4 . The strenghth W has been 



chosen in such a way that it remains weak enough not to alter 
any of the macroscopic properties, but strong enough to lift 
all possible degeneracies and, in the periodic case, to relax the 
selection rules associated with the translational invariance. 



7. Quantum observables presented in Fig. lb. 

In Fig. lb we analyze the properties of two integrals 
of motion, which are, in the case of a lattice with open 
boundary conditions, related to the counterparts of the fourth 
and sixth moments of the momentum distribution of the 
underlying free fermions. When expressed through the 
bosonic creation and annihilation operators, the functionals 
of the fermionic momentum distribution — quadratic in the 
fermionic representation — become complicated many-body 
observables, such as 



L-2 



/ 4 = (l/2L)£((StS i+2 +h.c.) 



-2(6]fe 3+1 fe] +1 ^ +2 +6] +2 fe J+1 6] +1 ^) 

- Q>{k + b{b L ) . 

Here, the second, four-body term is absent in the fermionic 
representation; the last term, present in both representations, 
is responsible for the finite size effects originating, in turn, 
from the open boundary conditions. 

We also studied a "generic" integral of motion i ran dom = 
Sa £ao l a o)(Q ! o|, where the states |ao) are the eigenstates of 
the hamiltonian in Eq. ( fl~6] l in the absence of the integrability- 
breaking perturbation, and the independent random coeffi- 
cients £„ were uniformly distributed between —1 and +1. 



8. Quantum observables presented in Fig. 3. 

In Fig. 3, we are comparing three thermodynamics ensem- 
bles: the microcanonical ensemble (based on energy alone), 

£ .i. = Span[{# }] , 

the conventional generalized Gibbs ensemble lU (based on 
occupation numbers of all free-fermionic one-body orbitals, 
or, in the case of periodic boundary conditions, all moments 
of the fermionic momentum distribution), 



£o.i. = Span 



2L 



rt((4 



j+m 



h.c.)) 



m = 1, 



, L/2 



3=1 



and the optimized generalized Gibbs ensemble (which is de- 
signed to maximize the quality of prediction for one-body ob- 
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servables), 



A>.i. = Span 



,-(«,&,+ h.c), 



j = 1, 



L;f =3, ■■■> L 



Only the first few most optimal integrals of motion generated 
by the latter space were used. Here <L are the free-fermionic 
annihilation operators, related to their bosonic counterparts 



via a Jordan- Wigner map, cL 



ii; 



i-Kb.,b., \ 



Here 



and below, we are assuming that the number of sites L is even. 

To compare the predictive powers of these ensembles, we 
compute their predictions for the momentum distribution of 
the bosons, 



1 

m = 1, i/2 . 



it serves as a prediction for the outcome of a given realiza- 
tion of the protocol. Remark that if 3 is one of the integrals 
of motion, the protocol reduces to the conventional General- 
ized Gibbs protocol with one additional integral of motion as 
a predictor. 

After a straightforward calculation one can further show 
that the mean square error (MSE) of the predictions of such 
an ensemble can be calculated analogously to the MSE pro- 
duced by the GGE with a single integral of motion (see Eq. 
HD: 



MSE[Prediction[Mean t [A]}} 

= Var GGE [(/3|^i|/3)] < 
Var MC [-4]cos 2 [6i 



(17) 



To derive this result, the following substitutions were used: 

A -> P„A 



H 



9. Beyond integrals of motion: Using generic observables as 
predictors for observables of interest. Single predictor 
observable and single observable of interest. 



i s 



(18) 



Imagine the following protocol. The initial state of the sys- 
tem is drawn at random, with equal probability, from a set of 
eigenstates \a!) of the hamilonian H: 

H\a') = E a \a!) . 

Prior to the beginning of the time propagation, we measure a 
predictor observable 3. The measurement can yield any of the 
results 3(8, where [/?) are the eigenstates of the operator 3: 



The axis of the values of 3 is tiled by a set of intervals 
[Ej, Sj+i]. 

We will assume further that similarly to all previously con- 
sidered observables, most of the matrix elements of 3 couple 
either two states both inside the microcanonical window or 
two states both outside of it. In particular, it is assumed that 
there exists a particular set D'^ of eigenstates of 3 that (ap- 
proximately) spans the same space as the one spanned by the 
eigenstates of H whose indices are in the set Di* defined in 



Eq. CCQ): 



Span[ 



S = Span[|a) : a G A*] 



The expectation value, conditional on being found in 
[Ej, 3j + i], of the infinite time average of the observable of 
interest A, is given by 



Prediction[Mean t [A]] 



E^ W\PhA\/3) 



E 
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